Linking IMAGACT Ontology to BabelNet through Action Videos
نویسندگان
چکیده
English. Herein we present a study dealing with the linking of two multilingual and multimedia resources, BabelNet and IMAGACT, which seeks to connect videos contained in the IMAGACT Ontology of Actions with related action concepts in BabelNet. The linking is based on a machine learning algorithm that exploits the lexical information of the two resources. The algorithm has been firstly trained and tested on a manually annotated dataset and then it was run on all the data, allowing to connect 773 IMAGACT action videos with 517 BabelNet synsets. This linkage aims to enrich BabelNet verbal entries with a visual representations and to connect the IMAGACT ontology to the huge BabelNet semantic network. Italiano. In questo articolo si presenta uno studio sul linking tra due risorse linguistiche multilingui e multimediali, BabelNet e IMAGACT. L’esperimento ha l’obiettivo di collegare i video dell’ontologia dell’azione IMAGACT con i concetti azionali contenuti in BabelNet. Il collegamento è realizzato attraverso un algoritmo di Machine Learning che sfrutta l’informazione lessicale delle due risorse. L’algoritmo è stato addestrato e valutato su un dataset annotato manualmente e poi eseguito sull’insieme totale dei dati, permettendo di collegare 773 video di IMAGACT con 517 synset di BabelNet. Questo linking ha lo scopo di arricchire le entrate verbali di BabelNet con una rappresentazione visuale e di collegare IMAGACT alla rete semantica di BabelNet.
منابع مشابه
Collecting Information for Action Understanding: The Enrichment of the IMAGACT Ontology of Action
This paper presents the status of our work aimed at enriching the IMAGACT Ontology of Action by linking it to other resources. In order to achieve this goal we performed a visual mapping, exploiting the IMAGACT visual component (video scenes that represent physical actions) as the linkage point among resources. By using visual objects, which are free from linguistic constraints and can be inter...
متن کاملFrom Synsets to Videos: Enriching ItalWordNet Multimodally
The paper describes the multimodal enrichment of ItalWordNet action verbs’ entries by means of an automatic mapping with a conceptual ontology of action types instantiated by video scenes (ImagAct). The two resources present significative differences as well as interesting complementary features, such that a mapping of these two resources can lead to a an enrichment of IWN, through the connecti...
متن کاملFrom Visual Prototypes of Action to Metaphors Extending the IMAGACT Ontology of Action to Secondary Meanings
This paper describes an infrastructure that has been designed to deal with corpus-based variations that do not fall within the primary, physical variation of action verbs. We have first established three main categories of secondary variation--metaphor, metonymy and idiom--and criteria for creating types within these categories for each verb. The criteria rely heavily on the images that compose...
متن کاملThe IMAGACT Visual Ontology. An Extendable Multilingual Infrastructure for the representation of lexical encoding of Action
Action verbs have many meanings, covering actions in different ontological types. Moreover, each language categorizes action in its own way. One verb can refer to many different actions and one action can be identified by more than one verb. The range of variations within and across languages is largely unknown, causing trouble for natural language processing tasks. IMAGACT is a corpus-based on...
متن کاملVerb Interpretation for Basic Action Types: Annotation, Ontology Induction and Creation of Prototypical Scenes
In the last 20 years dictionaries and lexicographic resources such as WordNet have started to be enriched with multimodal content. Short videos depicting basic actions support the user’s need (especially in second language acquisition) to fully understand the range of applicability of verbs. The IMAGACT project has among its results a repository of action verbs ontologically organised around pr...
متن کامل